
TITLE OF THE INVENTION 
INFORMATION CONTROL SYSTEM USING CAMERA 
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FIELD OF THE INVENTION 
The present invention relates to an information 
control system using a monitoring system capable of 
capturing moving images from a video camera, distributing 
them, and controlling the angle position of the camera 
(performing panning, tilting, and zooming operation) . 



BACKGROUND OF THE INVENTION 
Conventionally, a monitoring system capable of 
distributing pictures from a video camera and remotely 
controlling the angle position, i.e., the panning and 
15 tilting position, zoom magnification, and the like, of the 
camera is available. 

A camera (or a camera and a panhead on which the camera 
is mounted) used in such an apparatus allows a user to 
perform panning, tilting, and zooming operations by sending 
20 control signals from a computer to the camera through an 
RS-232C cable or the like. 

This conventional monitoring system has, for example, 
an arrangement like the one shown in Fig. 2. 

Referring to Fig. 2, a camera server 202 is connected 
25 to a network 201, and a camera 203 is connected to the camera 
server 202. A camera client 204 is also connected to the 
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network 201. The camera client 204 instructs the camera 
server 202 to control the camera, and receives and displays 
a picture sent from the camera server 202. 

Fig. 3 schematically shows the operation screen of 
5 the camera client 204. This operation screen includes an 
scroll box 31 in the form of a scroll bar which is used to 
perform panning operation, scroll boxes 32 and 33 for 
tilting and zooming operations, a control right button 34 
for obtaining a camera control right from the camera server, 

10 and a picture display unit 35 for displaying a picture 
sensed by the camera. 

Referring to Fig. 2, when the user performs panning, 
tilting, and zooming operations on the camera client 204, 
the camera client 204 transmits camera parameters (e.g., 

15 panning, tilt, and zoom values) designated by the user as 
a control command 205 to the camera server 202 through the 
network 201. Upon receiving a control command 206, the 
camera server 202 issues a control signal 207 to the camera 
203 to control the camera 203. The camera server 202 

20 changes the state of the camera first, and then notifies 
all connected camera clients of the current state (panning, 
tilt, and zoom values and the like) of the camera as camera 
data 208. Each camera client receives camera data 209 and 
recognizes the change in the current state of the camera. 

25 Since the camera server 202 transmits camera data to 

all the connected camera clients, even a camera client 210 
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that is not controlling the camera can receive the camera 
data and recognizes the change in current state of the 
camera . 

In addition, the camera server 202 also distributes 
picture data to all the camera clients through the network 
independently of the camera data. 

If a plurality of cameras are connected to one camera 
server, one of the cameras can be dynamically designated, 
and the target camera can be changed to the designated one 
in accordance with a request from a camera client. 

Owing to the feature of allowing many users* to control 
one camera, this conventional system is based on the idea 
of a control right that allows only one user to control the 
camera for a predetermined period of time. Each user must 
acquire this control right before operating the camera. 
Camera control commands include a control right acquisition 
command. This command is issued when the user presses the 
control right button 34 in Fig. 3. 

According to the prior art described above, when the 
camera is controlled, only a picture is provided in 
accordance with the angle position of the camera, but 
information about the main object of the picture cannot be 
obtained. 



SUMMARY OF THE INVENTION 
The present invention has been made in consideration 




of the above problem, and has as its object to provide an 
information control system which can implement a desired 
action in accordance with the angle position of a camera. 

In order to achieve the above object, according to 
5 an aspect of the present invention, there is provided an 
information control apparatus having control means for 
controlling a image sensing range of a camera, comprising: 
storage means for storing a program for operating a 
predetermined action; acquisition means for acquiring 
J;i| 10 information about a current image sensing range of the 

camera; control means for activating the program stored in 
0 said storage means in accordance with the information 

acquired by said acquisition means. 
; y According to another aspect of the present invention, 

..j 15 there is provided an information control apparatus having 

Z display means for displaying an image sensed by a camera, 

comprising: storage means for storing a program for 
operating an action for displaying a predetermined window 
together with an image displayed by said display means; 
20 acquisition means for acquiring information about a current 
image sensing range of the camera; and control means for 
activating the program storied in said storage means in 
accordance with the information acquired by said 
acquisition means, thereby executing display control of the 
25 predetermined window. 

According to still another aspect of the present 
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invention, there is provided an information control method 
having the control step of controlling a image sensing range 
of a camera, comprising: the storage step of storing a 
program for operating a predetermined action; the 
5 acquisition step of acquiring information about a current 
image sensing range of the camera; and the control step of 
activating the program stored in the storage step in 
accordance with the information acquired in the acquisition 
step . 

10 According to still another aspect of the present 

invention, there is provided an information control method 
having the display step of displaying an image sensed by 
a camera, comprising: the storage step of storing a program 
for operating an action for displaying a predetermined 

15 window together with an image displayed in the display step; 
the acquisition step of acquiring information about a 
current image sensing range of the camera; and the control 
step of activating the program stored in the storage step 
in accordance with the information acquired in the 

20 acquisition step, thereby executing display control of the 
predetermined window . 

According to still another aspect of the present 
invention, there is provided a computer-readable medium 
used for an information control method having the control 

25 step of controlling a image sensing range of a camera and 
storing a program comprising program codes of: the storage 



- 5 - 




step of storing a program for operating a predetermined 
action; the acquisition step of acquiring information about 
a current image sensing range of the camera; and the control 
step of activating the program stored in the storage step 
5 in accordance with the information acquired in the 
acquisition step. 

According to still another aspect of the present 
invention, there is provided a computer-readable medium 
used for an information control method having the display 

10 step of displaying an image sensed by a camera and storing 
a program comprising program codes of: the storage step of 
storing a program for operating an action for displaying 
a predetermined window together with an image displayed in 
the display step; the acquisition step of acquiring 

15 information about a current image sensing range of the 
camera; and the control step of activating the program 
stored in the storage step in accordance with the 
information acquired in the acquisition step, thereby 
executing display control of the predetermined window. 

20 

Other features and advantages of the present 
invention will be apparent from the following description 
taken in conjunction with the accompanying drawings, in 
which like reference characters designate the same or 
25 similar parts throughout the figures thereof. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing the system 

r 

configuration of the first embodiment; 

Fig. 2 is a view showing the arrangement of a network 
5 in the prior art or the first embodiment; 

Fig. 3 is a view for explaining a camera client 
operation screen; 

Fig. 4 is a view for explaining an action list; 
v ^ Fig. 5 is a view for explaining an action list file 

!« 10 format; 

[, : 5 

;^ Fig. 6 is a block diagram showing a process 

J j arrangement in the first embodiment; 

Fig. 7 is a flow chart showing a camera server process 
1.2 in the first embodiment; 

i=« 15 Fig. 8 is a flow chart showing a camera client process 

O in the first embodiment; 

|!3 

Fig. 9 is a view for explaining camera control 
command data packets; 

Fig. 10 is a flow chart showing a procedure in an 
20 action determination unit; 

Fig. 11 is a flow chart showing a procedure in an 
action activating unit; 

— - Fig. 12 is a block diagram showing the system 
configuration of the second embodiment; 
25 Fig. 13 is a flow chart showing a procedure in an 

action determination unit; 



- 7 - 




Fig. 14 is a flow chart showing a procedure in a 
control state determination unit; 

Fig. 15 is a block diagram showing the arrangement 
of the fourth embodiment; 
5 Fig. 16 is a flow chart showing a procedure in an 

action determination unit; 

Fig. 17 is a view showing an example of a display 
screen in the first embodiment; 
s ,=. Fig. 18 is a view showing another example of the 

j'S 10 display screen in the first embodiment; 

r i £ 

:~ Fig. 19 is a view showing still another example of 

the display screen in the first embodiment; and 

Fig.. 20 is a flow chart showing a procedure in an 
O action determination unit. 

hi 

•:: is- 

H .15 

O DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The preferred embodiments of the present invention 
will be described below with reference to the accompanying 
drawings . 
20 (First Embodiment) 

The first embodiment of the present invention will 
be described below. 

Since techniques for picture transmission and 
reception are the same as those used in the prior art, a 
25 description thereof will be omitted. Camera control will 
be mainly described below. 
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Fig. 1 shows the arrangement of a camera control 
system according to the first embodiment. Referring to 
Fig. 1, reference numeral 101 denotes a camera server 
apparatus; and 102, a camera client apparatus. These 
5 apparatuses are connected to each other through a network 
103. 

The camera server apparatus 101 will be described. 
An action storage control unit 116 stores the angle 
range (panning, tilt, and zoom ranges) of a camera 115 in 
10 a storage unit 120, together with programs for activating 
actions for the camera as an action list 117. 

The following are examples of these actions. 
• Control on Character Information about Main Object in 
Image sensing range of Camera 115 
15 Assume that panning, tilting, and zooming of the 

camera 115 are controlled, and Mt Fuji is image-sensed as 
a main object by the camera 115, as shown in Fig. 17. In 
this case, a program is activated to make a window 37 pop 
up in a display screen 36 displayed by a display unit 104, 
20 and an HTML document having information about Mt Fuji is 
displayed on the window 37. Note that not only characters 
may be displayed, but also a program for displaying images 
related to Mt Fuji on the window 37 or outputting audio data 
may be activated. 
25 • Operation/Setting of Equipment Connected to Network 
within Image sensing range of Camera 115 
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Assume that panning, tilting, and zooming of the 
camera 115 are controlled, and a printer 211 connected to 
a network 201 is image-sensed as a main object by the camera 
115, as shown in Fig. 18. In this case, as a program is 
5 activated, a window 38 pops up in the display screen 36 of 
the display unit 104, and the user can operate and set the 
printer 211 by using the window 37. 

• Transmission of Mail to Main Object within image-sensing 
P Range of Camera 115 

x« 10 Assume that panning, tilting, and zooming of the 

E . camera 115 are controlled, and a desk of a given person is 

'"■4 
-.. i 

i: 2 image-sensed as a main object by the camera 115, as shown 

: i s 

^ in Fig. 19. In this case, as a program is activated, the 

\-.J window 37 pops up in the display screen 36 of the display 

I* 15 unit 104, and a window for generating mail for which the 

12 person has already been designated as a destination is 

displayed on the window 37. 

The action list 117 may be stored in, for example, 
a registry provided by an OS. In this case, the action list 
20 117 is a file expressing a table like the one shown in Fig. 4, 
and the action storage control unit 116 serves as an editor 
for writing character strings in the file. An action 
program 123 stores a plurality of programs for activating 
actions listed in the action list 117, and can be downloaded 
25 into the camera client apparatus 102, as needed. 

Referring to Fig. 4, one line represents one action, 
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and PI and P2 indicate a panning angle range; Tl and T2, 
a tilt angle range; and Zl and Z2, a zoom magnification range. 
Command names and corresponding arguments are written in 
the "Action" column. 
5 For example, the action indicated by a line 401 

indicates that a command named Programl is activated with 
arguments argl and arg2 being supplied when the panning 
angle, tilt angle, and zoom magnification (expressed by a 
field angle in this case) of the camera fall within the range 

10 of 10° to 15°, the range of -25° to -20°, and the range of 
50° to 55°, respectively. 

In practice, the action list 117 may be written in 
a file format in which the respective items are delimited 
with tab characters, and a line feed character is entered 

15 at the end of description of each action. For example, the 
file shown in Fig. 5 is such a file. 

A camera control unit 114 is connected to the camera 
115 through a signal line or the like. The camera control 
unit 114 can operate the camera 115 by sending a control 

20 signal thereto, acquire the current state (panning, tilt, 
and zoom values, and the like) of the camera 115 therefrom, 
and store the acquired values in a camera state register 
118 

A command issuing/interpreting unit 113 interprets 
25 data received from the camera client apparatus 102 and 
responds to the request (the request to transmit the action 
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list 117, the request to operate the camera 115, or the 
control right acquisition request) . On the contrary, the 
command issuing/interpreting unit 113 generates camera 
data to be sent from the camera server apparatus to the 
5 camera client apparatus from the action list 117, the camera 
state register 118, and a destination list 119. Note that 
the destination list 119 stores information about all 
clients connected to the camera server apparatus 101, and 
camera data (camera state change notification) is sent to 

l'« 10 each camera client apparatus 102 on the basis of the 

! : 1 information. 

s ,2 A communication control unit 112 outputs the data 

• : ~ generated by the command issuing/interpreting unit 113 to 

^ the network 103 and receives data sent from the camera 

15 client apparatus 102. 
il The function of the camera server apparatus 101 has 

been described above. 

The camera client apparatus 102 will be described 

next . 

20 The display unit 104 has a user interface like the 

one shown in Fig. 3. The display unit 104 can receive a 
camera operation instruction from the user and display the 
current state of the camera 115 to notify it to the user. 
A display control unit 105 controls the screen display and 

25 operation described above. 

A command issuing/interpreting unit 106 generates a 
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camera control command a camera operation instruction on 
the display unit 104 which is detected by the display 
control unit 105, interprets camera data sent from the 
camera server apparatus 101, and performs corresponding 
5 operation (changes the display on the display unit 104 if 
the received data informs a change in state of the camera 
115) . 

If the data sent from the camera server apparatus 101 
is an action list (the ID of the command in Fig. 9 is ACT) , 
^% 10 the contents of the list are stored in an action list 110 

in a storage unit 111 of the camera client apparatus 102. 
^ An action program 122 stores a program for executing an 

E' fs 
5 : : t 

S--3 action activated by an action activating unit (to be 

□ described later) . 

!»& 15 A camera control command and camera data are packets 

q to be output to the network 103, and have a format like the 

one shown in Fig. 9. Referring to Fig. 9, destination 
addresses and source addresses are, for example, IP 
addresses in a TCP/IP network, CON, PAN, TIL, ZOM, CAM, and 
20 ACT are the IDs of the respective commands, P, T, and Z in 
2) to 4) and 6) are panning, tilt, and zoom values, 
respectively, and ACTIONLIST in 7) represents the action 
list 117 in Fig. 1 and is data like the one shown in Fig. 5. 

The communication control unit 107 sends a camera 
25 control command generated by the command 

issuing/interpreting unit 106 through the network 103, and 
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receives camera data sent from the camera server apparatus 
101 and transfers it to the command issuing/interpreting 
unit 106. 

An action determination unit 108 compares the camera 
5 data (indicating the current angle position of the camera) 
transmitted from the camera server apparatus 101 with the 
panning, tilt, and zoom ranges written in the action list 
110, and checks whether the camera data falls within the 
panning, tilt, and zoom ranges written in the action list. 
10 If they coincide with each other, the action determination 
unit 108 notifies an action activating unit 109 of the 
coincidence . 

The action activating unit 109 executes a designated 
action (activating a command) . 

15 The function of the camera client apparatus 102 has 

been described above. 

If the camera data transmitted from the camera server 
apparatus 101 to the camera client apparatus 102 represents 
a change in state of the camera 115 (the ID of the command 

20 in Fig. 9 is CAM) , the data is received by the communication 
control unit 107 and then sent to the display control unit 
105. As a consequence, the current state of the camera 115 
is displayed on the display unit 104 (this state is 
reflected in the scroll boxes 32, 33, and 31 in Fig. 3). 

25 At this time, the action determination unit 108 checks 
whether the angle of the camera is at the position 
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designated by the action list 110 to activate an action. 
If the action needs to be activated, the action activating 
unit 109 activates the action designated by the action list 
110. 

5 Fig. 6 shows a process arrangement showing the flow 

of processing in this embodiment. Each item in Fig. 6 will 
be described below. 

• Camera Control Server Process 601 

The camera control server process 601 receives camera 
10 control data issued by a client process 602, and outputs 
an instruction to the camera control unit to control the 
camera. In addition, the camera control server process 601 
notifies the client process 602 of the state of the camera, 
e.g., the panning and tilt angles and zoom magnification, 
15 and an action list as camera data. 

• Destination List 605/Camera State Register 603 

The destination list 605 and camera state register 
603 are shared memories used to exchange data between 
processes . 
20 • Client Process 602 

The client process 602 is a process for receiving a 
picture from the camera server 101 and outputting a camera 
control request to the camera server 101 . This process will 
be described in detail later with reference to Fig. 8. 
25 • Action List 604 

The action list 604 is a file like the one shown in 
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Fig. 5. 

Fig. 7 is a flow chart for explaining the camera 
control server process 601. 

When the camera control server process 601 is 
activated, required initialization processing is performed 
in step S701. Thereafter, in step S702, the communication 
control unit (112 in Fig. 1) waits for a control connection 
request from the client process 602. 

When a control connection request command (1) in 



10 Fig. 9) is received from the client process 602 in step S703, 



data for notifying the establishment of control connection 
is transmitted to the client (by returning data in the same 
form as that of 1) in Fig. 9) . 

Subsequently, the flow advances to step S704 to wait 

15 for another control command from the client. 

When a camera control command is received from the 
client process 602, it is checked in step S705 whether the 
controllable time has run out. This processing is 
performed to prevent a single user from keeping the control 

20 right for an excessively long period of time. If a 

predetermined period has elapsed, disconnection processing 
is performed in step S706, and the flow returns to step S702 . 

If the time has not run out yet, the command 
issuing/interpreting unit 113 interprets the command in 

25 step S707, and the flow branches to processing 
corresponding the command. 
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If the received command is a control request command 
(1) in Fig. 9) , processing is performed to give the control 
right to the client in step S708. This processing is also 
performed in the conventional system described above, and 
5 hence a detailed description thereof will be omitted. 

The flow further advances to step S709 to generate 
control right notification data (1) in Fig. 9) for 
notifying that the control right is given to the client by 
replacing the source and destination addresses in the 
10 control right request command (1) in Fig. 9). 

In step S710, this data is transmitted to only the 
camera client that has requested the control right. 

:' ~ 

O If the received command is a camera control command 

O (2) to 4) in Fig. 9), the camera control unit (113 in Fig. 1) 

I* 15 performs camera control in step S711. In step S712, the 

1*3 camera state after the control is written in the camera 

state register 603. 

In step S713, the command issuing/interpreting unit 
113 in Fig. 1 generates camera data (6) in Fig. 9) from the 
20 data stored in the destination list 605 and camera state 
register 603. To notify a plurality of camera clients of 
the camera data, camera data having client addresses as 
destination addresses in Fig. 9 are generated by the same 
number as that of clients. 
25 In step S710, the communication control unit (112 in 

Fig . 1 ) transmits the camera data to all the camera clients . 
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If it is determined in step S707 that the command is 
an action list request (5) in Fig. 9) , action list 
notification data (7) in Fig. 9) is generated from the 
action list 604 and the source address in the action list 
5 request command (5) in Fig. 9) . In step S710, the action 
list data is transmitted to the camera client that has 
generated the request . 

The flow of processing in the camera server 101 has 
been described above . 
10 The flow of processing in the camera client apparatus 

102 will be described next with reference to Fig. 8. 

When the client process 602 is activated, required 
initialization (e.g., turning off the control right flag) 
is performed in step S801. In step S802, a user interface 
15 like the one shown in Fig. 3 is displayed on the display 
unit 104 

In step S803, a connection request is output to the 
camera server 101, and connection permission from the 
server is confirmed. 

20 In step S804, an action list request is output by 

transmitting data indicated by 5) in Fig. 9 to the camera 
server 101. The camera client stores the action list in 
the action list 110 in Fig. 1 by causing the command 
issuing/interpreting unit (106 in Fig. 1) to interpret the 

25 action list notification data (7) in Fig. 9) returned from 
the server. 
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The flow then advances to step S805 to wait for 
operation by the user and data from the camera server 101. 

If it is determined in step S805 that the user has 
pressed the control right acquisition button, the flow 
5 advances to step S806 to generate a control right request 
command (1) in Fig. 9) by using the command 
issuing/interpreting unit (106 in Fig. 1) and transmit the 
command to the camera server 101 by using the communication 
control unit (107 in Fig. 1). The flow returns to step 
10 S805. 

If it is determined in step S805 that a control right 
notification is received from the camera server 101 (8) in 
Fig. 9), the flow advances to step S807 to turned on the 
control right flag (121 in Fig. 1) . The flow then returns 

15 to step S805. 

If the user performs panning, tilting, and zooming 
operations in step S805, the flow advances to step S808 to 
check the control right flag (121 in Fig. 1) . If the flag 
is ON, a camera control command (2) to 4) in Fig. 9) is 

20 generated by using the command issuing/interpreting unit 
(106 in Fig. 1) . This command is transmitted to the camera 
server 101 by using the communication control unit (107 in 
Fig. 1) . The flow then returns to step S805. 

If it is determined in step S805 that a camera state 

25 notification (6) in Fig. 9) is received from the camera 
server 101, the flow advances to step S810 to change the 
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display of the display terminal apparatus. In step S811, 
the action determination unit 108 performs action 
determination. This processing will be descried later. 

If it is determined that the angle position of the 
5 camera is at a position where an action should be activated, 
the action activating unit 109 activates a designated 
action in step S812. The action activating unit 109 will 
be described later. Thereafter, the flow returns to step 
S805. 

10 The following is the flow of processing in the camera 

client apparatus. 

The action determination unit 108 will be described 

next . 

Fig. 10 is a flow chart showing a procedure in the 
15 action determination unit 108. 

In step S1001, the action determination unit 108 
loads panning, tilt, and zoom values in camera data notified 
from the camera server 101. 

In step S1002, the action determination unit 108 
20 loads one line from the action list 110, and loads data 
corresponding to the items of PI, P2, Tl, T2, Zl, and Z2 
in Fig. 4. 

In step S1003 and subsequent steps, the action 
determination unit 108 checks whether the panning, tilt, 
25 and zoom values fall within the designated ranges, 

respectively. Consider, for example, the panning value. 
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The action determination unit 108 checks whether the 
panning value in the camera data notified from the camera 
server falls within the range between PI and P2 written in 
one line of the action list loaded in step S1002. 
5 If it is determined in step S1003 and the subsequent 

steps that all the panning, tilt, and zoom values fall 
within the ranges, the action determination unit 108 
transfers the items in the "Action" column in the action 
list (see Fig. 4) to the action activating unit 109 and 

10 delegates the processing thereto. 

In step S1007, it is checked whether all the lines 
of the action list are determined. If NO in step S1007, 
the flow returns to step S1002. If YES in step S1007, the 
processing is terminated. 

15 The operation of the action determination unit 108 

has been described above. 

The action activating unit 109 will be described 

next . 

The action activating unit 109 activates a command 
20 in accordance with a command name written in an action list 
and an argument corresponding to the command. 

Fig. 11 is a flow chart for explaining the action 
activating unit 109. 

In step S1101, the action activating unit 109 loads 
25 a command transferred from the action determination unit 
108. This command is written in the action list and 
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corresponds to an item in the "Action" column. 

In step S1102, the action activating unit 109 
activates the command. The operating system has the 
function of activating an executable file (program) in a 
5 file system by designating a command name and argument. 
This function corresponds to "exec system call" in the Unix 
operating system, and operating systems such as Windows 95 
and Windows NT (tradenames) have the same function . Instep 
^ S1102, the command is executed by using such a method. At 

; : S 10 this time, the camera client apparatus 102 sends, to the 

V- 1 

J~ camera server 101, a request to download a program for 

"J activating the action having undergone the action 

O determination processing from the action program 123. The 

0 command is executed on the basis of the downloaded program. 

1 ,t 

{>& 15 Note that all programs stored in this action program 123 

"~£ 

q may be stored beforehand in the action program 122 on the 

camera client apparatus 102 side concurrently with the 
transmission of action list data (step S710 in Fig. 7) , and 
a command may be executed by selecting a program from a 

20 plurality of stored programs. Furthermore, the 

corresponding program may have already existed in the 
action program 122. 

The operation of the action activating unit 109 has 
been described above. 

25 As described above, according to this embodiment, an 

action designated by the camera server apparatus in advance 
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can be activated on the camera client by operating the 
camera and changing its angle. That is, since a program 
for operating an action is activated after the camera 115 
is controlled within a predetermined image sensing range, 
5 operation burden of the action activating unit 109 is 
reduced . 



( Second Embodiment ) 

The second embodiment will be described below. 
] : ~ 10 Fig. 12 shows the arrangement of the second 

embodiment. The arrangement of the second embodiment 
it £ differs from that of the first embodiment in Fig. 1 in that 

^ a control state determination unit 1202 is added, and an 

P action determination unit 1201 is obtained by modifying the 

!'» 15 action determination unit 108 in the first embodiment. The 

O arrangement of the remaining portion is the same as that 

O 

of the first embodiment described with reference to Fig. 1, 

and hence a description thereof will be omitted. 

Fig. 13 is a flow chart showing a procedure in the 
20 action determination unit 1201 according to this embodiment . 

This flow chart is identical to that shown in Fig. 10 except 

for the addition of step S1301. 

In step S1301, the control state determination unit 

1202 checks whether the camera client currently has the 
25 control right to the camera 115. If NO in step S1301, the 

processing is immediately terminated (no action is 
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activated) . Only if the camera client has the control right 
to the camera 115, it is checked whether an action is 
activated . 

The control state determination unit 1202 checks 
5 whether the user has the control right to the camera 115. 
More specifically, the control state determination unit 
1202 checks a control right flag 121. 

Fig. 14 is a flow chart showing a procedure in the 
control state determination unit 1202. 
10 In step S1401, the control state determination unit 

\}\ 1202 checks the state of the control right flag 121. If 

^ the flag is ON, the control state determination unit 1202 

-3 determines "true" in step S1402. If the flag is OFF, the 

□ control state determination unit 1202 determines "false" 

W 

M= 15 in step S1403. The processing is then terminated. 

|; 3 With the arrangement of this embodiment, a specific 

action having significance for only a user having the 
control right to a camera 115 can be executed on only the 
client having the control right to the camera 115 without 
20 being activated on any client that does not have the control 
right to the camera 115. If, for example, an action such 
as a printer setting/operation like the one shown in Fig. 18 
is executed on a plurality of client apparatuses at once, 
a problem arises. Such a problem can be solved by making 
25 only the client having the control right to the camera 115 
to execute an action such as equipment setting/operation. 
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In addition, in activating mail software like the one 
shown in Fig. 19, since the probability that clients who 
do not have the right control of the camera 115 want to 
transmit electronic mail to a main object is low, the 
5 program is preferably activated only on the client having 
the control right . 

Furthermore, a flag indicating that the action is to 
be activated only when information indicating that the 
corresponding client has the control right is written in 

1 

10 the action list, or a flag indicating that the action is 
I* to be activated even without the control right may be added, 

^ thereby changing the contents of actions to be activated 

^ depending on whether a given client has the control right 

£3 or not. By identifying the flag added in this manner, for 

VJ 

[a 15 example, in displaying information about a main object with 

p an HTML document like the one shown in Fig. 17, the 

corresponding action is activated with respect to all 
clients which are accessing the camera server 202 
regardless of whether the clients have the right control 
20 of the camera 115. On the other hand, for example, the above 
action for activating printer setting/operation shown in 
Fig. 18, an action for activating mail software, or the like 
is activated for only the client having the control right 
to the camera 115. In this manner, actions can be activated 
25 suitably for the respective clients. 
(Third Embodiment) 
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The third embodiment will be described below. 
In this embodiment, the action list in the first 
embodiment shown in Fig. 5 additionally includes a flag for 
determining whether to end an action in a case wherein the 
camera 115 is controlled during operation of the action by 
a given program, and the image sensing range has fallen 
outside the activation range of the action. 

The arrangement of this embodiment is the same as that 
shown in Fig. 1 except that the action list 110 in Fig. 1 
dditionally includes a flag for determining whether to end 
an action in a case wherein the image sensing range has 
fallen outside the activation range of the action, and hence 
a description thereof will be omitted. 

Fig. 20 is a flow chart showing a procedure in an 
action determination unit 108 in this embodiment. The flow 
chart of Fig. 20 is identical to that of Fig. 10 except that 
processing in steps S2001 to S2004 is added. 

If parameters, i.e., the panning, tilt, and zoom 
values of a camera 115, fall outside the activation 
operation range of a predetermined action (program) , it is 
checked in step S2001 whether the action as the current 
target is being activated. If NO in step S2001, the flow 
advances to step S1007. If YES in step S2001, the flow 
advances to step S2002. 

In step S2002, the action determination unit 108 
checks the flag indicating whether the target action is 



ended or not. If the flag is "1", the flow advances to step 
S2004. If the flag is "0", the flow advances to step S2003. 

In this embodiment, if this flag is "1", the operation 
is kept performed even if the above parameters fall outside 
5 the activation range of the action. If the flag is "0" , 
the operation is terminated. As an action for which flag 
"1" is added, the printer setting/operation shown in 
Fig. 18 or the activation of electronic mail software shown 
j;3 in Fig. 19 is conceivable. These actions (programs) are 

f_fj 10 preferably kept performed unless a corresponding 

fLJ 

h t j instruction is received from the user even if the image 

i-.Z sensing range is changed. As an action for which flag "0" 

•~ is added, the display of character information about the 

] : - t image sensing range shown in Fig. 17 is conceivable. If 

15 the image sensing range of the camera 115 changes, an object 
□ does not correspond to the displayed character information. 

Therefore, this action is preferably changed. 

In step S2003, the end of the target action under 
operation is designated. In step S2004, the continuation 
20 of the target action under operation is designated. 

According to the above embodiment, when the image 
sensing range changes, whether to continue the operation 
of each action can be controlled depending on each action. 
This makes it possible to appropriately control each 
25 action. 

( Fourth Embodiment ) 
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The fourth embodiment will be described below. 
Fig. 15 shows the arrangement of the fourth 
embodiment. This arrangement is obtained by adding a 
picture switching unit 1501 to the camera server apparatus 
5 in the first embodiment shown in Fig. 1, and an action 
determination unit 1502, which is installed on the camera 
client apparatus side in the first embodiment is also 
installed on the camera server apparatus 1101 side. Since 
in the arrangement of the remaining portion is the same as that 

ifl 10 in the first embodiment, a description thereof will be 

'1 omitted. 

■ t.t 

"5; 

The picture switching unit 1501 is a technique that 
* ,B# has already been accomplished in the prior art . The picture 

] ; =» switching unit 1501 can connect and switch a plurality of 

I s * 15 cameras by using the input switching function or the like 

P of a video capture board 1504 (capable of receiving a 

plurality of video inputs) in the camera server apparatus. 

An action activating unit 1503 is identical to the 
one described in the first embodiment. 
20 The action determination unit 1502 is similar to the 

action determination unit 108 described in the first 
embodiment. However, the difference between these units 
will be described. 

Fig. 16 is a flow chart showing a procedure in the 
25 action determination unit 1502 in this embodiment. 

Steps S1601 to S1603 are the same as steps S1001 to 
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S1005 in Fig. 10. 

In step S1604 , it is checked whether a command written 
in the "Action" column of an action list is a picture 
switching action. Assume that a character string 
5 "VIDEOCHANGE" is written in the "Action" column (in which 
command names are basically written) of a picture switching 
action. In this case, this character sting is checked. 

If the command is a picture switching action, the flow 
advances to step S1606 to switch pictures by using the 

=.3 

j'= 10 picture switching unit 1501. 

v\l 

:~ If the command is not a picture switching action, the 

' : 4 

:: 2 flow advances to step S1605 to activate the action by using 

^ the action activating unit 1503 (on the server) . For 

?3 example, data such as character information corresponding 

M 15 to the current image sensing range is output to a client 

o 102 on the basis of the activated action. Note that data 

such as character information may be output to not only the 
client 102 (i.e., a client which is receiving a picture 
obtained a camera 115 from the camera server 101) which is 
20 operating the camera but also the client 102 which is 
currently connected to a camera server 101. 

With the above arrangement, when, for example, the 
camera is operated up to the panning angle limit, the 
current picture can be switched to a picture taken by 
25 another camera angled for a portion which cannot be 
image-sensed by the above camera. 
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Note that if both a server and a client have action 
activating means as in this embodiment, actions can be 
selectively activated by providing the respective actions 
with flags each indicating that the corresponding action 
5 is effective only on the server or client. 

Consider, for example, an action for displaying 
character information corresponding to the current image 
sensing range of the camera 115. If a flag for activating 
i=3 this action is prepared on the camera server apparatus 101 

jP E 10 side, the action determination unit 1502 determines the use 

!l of the action activating unit 1503 on the camera server 101 

side. As a consequence, the action activating unit 1503 
activates a program (stored in the action program 123) for 
^ executing the action. Character information output on the 

S.J 

i : *= 15 basis of the execution of the action may be output to the 

O client 102 to be displayed. With this arrangement, the 

transmission capacity required on the network can be 

reduced. 

In addition, consider an action for executing 
20 operation/setting of equipment existing in the current 
image sensing range of the camera 115. In this case, if 
a flag for activating the action is prepared on the client 
102 side, the action determination unit 1502 determines the 
use of the action activating unit 109 on the client 102. 
25 As a consequence, the action activating unit 109 activates 
a program (stored in the action program 122) for executing 
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the action. The execution program used in this case is 
downloaded from the camera server 101 when the action 
determination unit 1502 determines the use of the action 
activating unit 109, or may be downloaded in advance on the 
5 client 102 side. 

Note that the arrangement of the second embodiment 
may be applied to the fourth embodiment. In this case, the 
camera server 101 may cause only the client 102 having the 
control right to download a program for executing a 

10 predetermined action. The client 102 having the control 
right can execute the action in accordance with the 
downloaded program. 

The objects of the above-mentioned embodiments are 
also achieved by supplying a storage medium, which records 

15 a program code of a software program that can realize the 
functions of the above-mentioned embodiments to the system 
or apparatus, and reading out and executing the program code 
stored in the storage medium by a computer (or a CPU or MPU) 
of the system or apparatus. In this case, the program code 

20 itself read out from the storage medium realizes the 
functions of the above-mentioned embodiments, and the 
storage medium which stores the program code constitutes the 
present invention. The functions of the above-mentioned 
embodiments may be realized not only by executing the readout 

2 5 program code by the computer but also by some or all of actual 
processing operations executed by an OS (operating system) 
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running on the computer on the basis of an instruction of 
the program code. 

Furthermore, the functions of the above-mentioned 
embodiments may be realized by some or all of actual 
5 processing operations executed by a CPU or the like arranged 
in a function extension board or a function extension unit, 
which is inserted in or connected to the computer, after the 
program code read out from the storage medium is written in 
^ a memory of the extension board or unit. 

j'S 10 When the present invention is to be applied to the above 

;/i storage medium, program codes corresponding to the flow 

charts described above (shown in Figs . 7, 8, 10, 11, 13, 14, 

; t 
; t 

^ and 16) are stored in the storage medium. 

O As has been described above, according to the present 

!=* 15 invention, a specific predetermined action can be operated 

□ in accordance with the angle position of the camera. 

As many apparently widely different embodiments of 
the present invention can be made without departing from 
the spirit and scope thereof, it is to be understood that 
20 the invention is not limited to the specific embodiments 
thereof except as defined in the appended claims. 
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